Controlling quarantining and biasing in cataclysms for optimization simulations

ABSTRACT

Some examples are directed to selecting at least one candidate solution from a first plurality of candidate solutions that has converged on a suboptimal solution during a computer simulation. The computer simulation tests fitness of the first plurality of candidate solutions for an optimization problem. Some examples are further direct to storing a copy of the at least one candidate solution, performing a cataclysm on the first plurality of candidate solutions, and generating a second plurality of candidate solutions. Some examples are further direct to integrating the copy of the at least one candidate solution into the second plurality of candidate solutions after performing of one or more additional computer simulations that test the fitness of the second plurality of candidate solutions for the optimization problem.

RELATED APPLICATIONS

This application is a continuation of, and claims the priority benefitof, U.S. application Ser. No. 13/916,301 filed Jun. 12, 2013, whichclaims the priority benefit of U.S. application Ser. No. 12/954,296filed Nov. 24, 2010. The Ser. No. 13/916,301 application and the Ser.No. 12/954,296 application are each incorporated herein by reference.

BACKGROUND

Embodiments of the inventive subject matter generally relate to thefield of optimization, and, more particularly, to performing cataclysmsin optimization simulations.

Optimization algorithms are used to find solutions to optimizationproblems by starting with an initial set of random candidate solutions(e.g., provided by a user, randomly generated, etc.) and iterativelyanalyzing and modifying the candidate solutions, according to anobjective function, until reaching a satisfactory solution. Optimizationalgorithms may also be referred to as metaheuristic optimizationalgorithms, combinatorial optimization algorithms, soft-computingalgorithms, etc. For instance, one type of optimization algorithm is anevolutionary algorithm. An evolutionary algorithm uses techniquesloosely based on biological evolution, reproduction, mutation,recombination, and natural selection to find solutions to optimizationproblems. Simulations that implement evolutionary algorithms act uponpopulations, such that individuals in a population represent candidatesolutions to an optimization problem. The candidate solutions areevaluated for fitness (i.e., evaluated according to a fitness function)and the population “evolves” as successive generations of the populationare selected/generated and modified loosely based on the biologicaltechniques. As the population evolves, overall fitness of the populationtends to increase. A solution to the optimization problem is found whenthe overall fitness of the population has reached a satisfactory level,or in other words, when the fitness function, or other objectivefunction, evaluates to an optimal solution. Simulations based onoptimization algorithms, such as evolutionary algorithms, can performwell for finding solutions to problems in engineering, biology,economics, robotics, etc. because objective functions can be tailored tofit the problems.

SUMMARY

Some embodiments are directed to selecting at least one candidatesolution from a first plurality of candidate solutions that hasconverged on a suboptimal solution during a computer simulation. Thecomputer simulation tests fitness of the first plurality of candidatesolutions for an optimization problem. Some examples are further directto storing a copy of the at least one candidate solution, performing acataclysm on the first plurality of candidate solutions, and generatinga second plurality of candidate solutions. Some examples are furtherdirect to integrating the copy of the at least one candidate solutioninto the second plurality of candidate solutions after performing of oneor more additional computer simulations that test the fitness of thesecond plurality of candidate solutions for the optimization problem.

BRIEF DESCRIPTION OF THE DRAWINGS

The present embodiments may be better understood, and numerous objects,features, and advantages made apparent to those skilled in the art byreferencing the accompanying drawings.

FIG. 1 is an example conceptual diagram of performing an optimizationalgorithm simulation using a cataclysm controller according to someembodiments.

FIG. 2 is an example conceptual diagram depicting quarantining anindividual candidate solution and inserting the individual into aninverse biased population after multiple generations of a simulation ofan optimization problem.

FIG. 3 is a flowchart depicting example operations for generating aninversely biased population during a simulation of an optimizationproblem.

FIGS. 4 and 5 are example conceptual diagrams of generating an inverselybiased population during a simulation of an optimization problem.

FIG. 6 is a flowchart depicting example operations for quarantining anindividual from a first population of candidate solutions during asimulation of an optimization problem and integrating the individual ina second population of candidate solutions.

FIG. 7 depicts an example computer system.

DESCRIPTION OF EMBODIMENT(S)

The description that follows includes exemplary systems, methods,techniques, instruction sequences, and computer program products thatembody techniques of the present inventive subject matter. However, itis understood that the described embodiments may be practiced withoutthese specific details. For instance, although examples refer topopulation-based optimization algorithm simulations some embodiments mayutilize non-population based metaheuristics. Further, although someembodiments can utilize specific types of evolutionary algorithms (e.g.,genetic algorithms, genetic programming, evolutionary programming,evolution strategy, etc.) suited to fit a particular type ofoptimization problem being solved, other instances, examples may utilizeswarm intelligence algorithms (e.g., ant colony optimization, particleswarm optimization, stochastic diffusion search, gravitational searchalgorithms, intelligent water drops algorithms, etc.), differentialevolution algorithms, artificial life algorithms, cultural algorithms,harmony search algorithms, artificial immune system algorithms (e.g.,clonal selection algorithms, negative selection algorithms, immunenetwork algorithms, dendritic cell algorithms, learning classifiersystem algorithms, learnable evolution model algorithms, etc.),population-based incremental learning algorithms, etc. In otherinstances, well-known instruction instances, protocols, structures, andtechniques have not been shown in detail in order not to obfuscate thedescription.

As indicated previously, during a simulation for an optimizationproblem, candidate solutions to an optimization problem can be evaluatedagainst a fitness function. Usually an initial generation of apopulation (e.g., generation “0”) of candidate solutions is unfit andrequires many generations, or repeat applications of a population-basedoptimization algorithm for the population to reach a satisfactory levelof fitness. For example, repeat computations of an evolutionaryalgorithm cause “evolutionary” advancements, or improvements, to apopulation's fitness level based loosely on biological techniques.

Sometimes, however, the fitness of a population may stagnate. Forinstance, evolutionary advancements to candidate solutions may plateau,or become largely homogenous. In other words, a population canprematurely converge on one individual from a local optima of thesolution space resulting in a sub-optimal solution. Prematureconvergence can be detected by observing a number of generations sincethe fitness of the best individual, and/or the average fitness of thepopulation, has improved. Crosses with that individual, combined withgenetic drift, result in a loss of genetic variation. The populationbecomes largely homogenous, made up of similar candidate solutions thatexhibit the same salient features. Crosses between pairs of the similarcandidate solutions are unable to produce a superior solution. Thesimulation of the optimization problem, however, may yet produce bettersolutions if the population is forced to change, or to become lesshomogenous. To force the population to change requires a breakthrough,or a major shock to the fitness level in the evolutionary process. Someexamples of forcing the population to change in evolutionary algorithmsinclude crossovers and mutations to some or all of the candidatesolutions. Sometimes, however, crossovers and mutations may not beshocking enough (e.g., a hamming distance is not great enough togenerate a major difference to the homogeneity of the candidate solutionset). In such examples, a cataclysm is often an effective way ofintroducing a major shock. A cataclysm attempts to simulate thecatastrophic events that punctuate the natural evolutionary process,such as by introducing a large number of randomly-generated candidatesolutions or severely-mutating candidate solutions to increasediversity.

One way of performing a cataclysm includes picking out one candidatesolution or “individual” (e.g., pick a fit individual) from thepopulation to be a survivor, and then modifying all individuals from thepopulation of candidate solutions (e.g., typically via random mutations)except for the survivor. As generations progress, the survivor interactswith the modified individuals and potentially generates newer and fitterindividuals (e.g., breaks the population out of the local optima andbegins making progress again). Some approaches to performing cataclysmssimply perform cataclysm after cataclysm until the cataclysms stopworking (e.g., the survivor individual tends to continue getting fitterand will more quickly dominate a population after a cataclysm).

FIG. 1 is an example conceptual diagram of performing a optimizationalgorithm simulation using a cataclysm controller according to someembodiments. In FIG. 1, a population-based optimization algorithmsimulator 101 receives an optimization problem description (“problemdescription”) 113. The problem description 113 defines the optimizationproblem. Examples of optimization problems include circuit design, adderdesign, compiler tuning, etc. The problem description 113 can indicatevariables of the optimization problem, a domain for the candidatesolutions, constraints, a fitness evaluation function, seed candidatesolutions, criteria for inserting the seed candidate solutions,termination criteria, etc. In some embodiments, the problem description113 may be included in a specification file. Other embodiments, however,may not utilize a specification file, but instead may ascertain theproblem description 113 by accessing hard coded instructions, linkedinformation, data input from a user via a graphical user interface, etc.In some embodiments, the problem description 113 may also beconstrained, or in other words, may have to meet constraint descriptions119.

The population-based optimization algorithm simulator 101 generates aninitial population (103) (i.e., a population of an initial generation)based on the received problem description. The population comprises aplurality of candidate solutions to the optimization problem. In someembodiments, each of the candidate solutions can be represented by adataset organized based on the variables of the optimization problem.Each dataset can store one value/parameter for each of the variables,such that an optimization problem with N variables can have datasetscomprising N parameters. The population-based optimization algorithmsimulator 101 determines a number of candidate solutions to generatebased on the problem description 113. For example, the problemdescription 113 indicates that the population should comprise onehundred candidate solutions. The population-based optimization algorithmsimulator 101 can generate parameters for the candidate solutions basedon the domain indicated in the problem description 113 and constraintdescriptions 119.

After generating the initial population 103, the population-basedoptimization algorithm simulator 101 begins a population-basedoptimization algorithm simulation. For example, the population-basedoptimization algorithm simulator 101 evaluates the population (105). Thepopulation-based optimization algorithm simulator 101 can evaluate eachcandidate solution by applying the parameters indicated in the candidatesolutions to variables in the optimization problem and running asimulation of the candidate solution. For example, the problemdescription 113 can define an electronic design. The population-basedoptimization algorithm simulator 101 can generate simulation decks foreach candidate solution based on applying the parameters indicated byeach candidate solution to variables of the electronic design. Thepopulation-based optimization algorithm simulator 101 can run asimulation of each simulation deck using a Simulation Program withIntegrated Circuit Emphasis (SPICE) simulation tool and collect resultsof each simulation. As another example, the problem description 113indicates a computer program to be optimized. The population-basedoptimization algorithm simulator 101 can run the computer program foreach of the candidate solutions by applying the parameters of thecandidate solutions to variables of the computer program. Thepopulation-based optimization algorithm simulator 101 can collectresults of each run of the computer program. The techniques (e.g., SPICEsimulations, running computer programs, etc.) for evaluating thepopulation can be defined as part of the fitness evaluation functionindicated in the problem description 113.

The population-based optimization algorithm simulator 101 furtherdetermines fitness of the population (107). The fitness can berepresented by a numerical value within a range specified in the problemdescription 113. For example, the fitness can be represented by apercentage. Determining fitness of the population 107 can comprisedetermining individual fitness metrics of each candidate solution. Thepopulation-based optimization algorithm simulator 101 can determine eachcandidate solution's individual fitness metric based on the fitnessevaluation function indicated in the problem description 113. Forexample, the population-based optimization algorithm simulator 101 cananalyze the simulation results of each candidate solution based onindicated heuristics. The population-based optimization algorithmsimulator 101 can determine the fitness of the population based onaggregating the individual fitness metrics. For example, thepopulation-based optimization algorithm simulator 101 can average theindividual fitness metrics. As another example, the population-basedoptimization algorithm simulator 101 can take the median of theindividual fitness metrics.

The population-based optimization algorithm simulator 101 furtherdetermines if termination criteria have been met (111). The problemdescription 113 can indicate termination criteria. For example, thepopulation-based optimization algorithm simulation may terminate whenfitness of the population reaches an indicated satisfactory level. Asanother example, the population-based optimization algorithm simulationmay terminate when fitness of the population reaches a plateau. Asanother example, the population-based optimization algorithm simulationmay terminate when a specified number of generations has been reached.The population-based optimization algorithm simulator 101 outputs asolution 117 when termination criteria are met. The solution 117includes indications of each of the candidate solutions that constitutethe population at termination, individual fitness metrics of each of thecandidate solutions, simulation/test results, etc.

If the termination criteria have not been met, the population-basedoptimization algorithm simulator 101 computes (e.g., generates) a nextgeneration of the population (109). For example, the current generationis generation “0,” so the population-based optimization algorithmsimulator 101 computes a generation “1.” The population-basedoptimization algorithm simulator 101 can compute the next generation inaccordance with a combination of biological techniques loosely based onevolution, reproduction, mutation, recombination, and natural selection.For example, the population-based optimization algorithm simulator 101can select a certain number of the candidate solutions of generation “0”to remain unchanged in generation “1” based on survival of the fittesttechniques. The unchanged individuals can represent a portion of thepopulation of generation “1.” As another example, the population-basedoptimization algorithm simulator 101 can select candidate solutions fromgeneration “0” as parents to reproduce offspring candidate solutions fora portion of the population of generation “1.” As another example,another portion of the population can be generated based on mutatingcandidate solutions of generation “0.” After the next generation of thepopulation is determined, the population-based optimization algorithmsimulator 101 repeats the evaluation (105) and determination of fitness(107) on the next generation. The blocks 105, 107, 111, and 109 repeatfor each successive generation until termination criteria is met.

In some embodiments, a cataclysm controller 110 performs cataclysms whenpopulations become homogenous, or when fitness of a population plateausand settles into a sub-optimal solution set (e.g., converges on asuboptimal candidate solution for a local optima of the solution space).The cataclysm controller 110 quarantines a survivor from a first(pre-cataclysmic) population and delays complete integration of thesurvivor into a second (post-cataclysmic) population until the secondpopulation has undergone one or more generations of the post-cataclysmpopulation, but before fitness of the post-cataclysmic populationsettles on a sub-optimal solution. The cataclysm controller 110 alsogenerates, or assists in generating, a second population (e.g., amodified first population, an entirely new population, etc.) that isinversely, or oppositely, biased from the first population. Examples ofquarantining survivors and inversely biasing a population are describedin further detail below in FIGS. 2, 3, 4, 5 and 6. Quarantiningsurvivors and biasing a population can be implemented separately ortogether. Further, although FIG. 1 depicts the cataclysm controller 110as a component of the population-based optimization algorithm simulator101, the cataclysm controller 110 can be a separate element from thepopulation-based optimization algorithm simulator 101.

FIG. 2 is an example conceptual diagram depicting quarantining anindividual candidate solution and integrating the individual into aninverse biased population after multiple generations of a simulation ofan optimization problem. In FIG. 2, the cataclysm controller 110, atstage “A,” determines that a first, pre-cataclysmic population ofcandidate solutions (first population) 220 should undergo a cataclysm.For instance, the first population 220 has converged on a suboptimalcandidate solution for a local optima of the search space and thecandidate solutions in the first population 220 have become homogenous.The candidate solutions of the first population 220 may be coded asbinary strings, with values of either one (“1”) or zero (“0”) in eachbit position. The cataclysm controller 110, at stage “B,” quarantines atleast one individual candidate solution (survivor individual) 207 tosurvive from the first population 220. The survivor individual 207 canbe selected for its fitness, meaning that the survivor may be more fitthan most of the other candidate solutions in the first population 220according to a fitness function. However, because the first population220 is homogenous, most of the candidate solutions in the firstpopulation 220 have many of the same characteristics in common asdescribed previously. Consequently, most of the candidate solutions inthe first population 220 have most of their bits values in common, withvery little difference between each candidate solution. In other words,most of the candidate solutions in the first population 220 have similardegrees of fitness. As a result, the survivor individual 207 may also beselected randomly and have a similar degree of fitness compared to mostof the other candidate solutions in the first population 220.

The cataclysm controller 110 includes a biased population generator 212.The biased population generator 212 generates a second population 280with individuals that are randomly selected, but intentionally inverselybiased, or oppositely biased, from the first population 220 and thesurvivor individual 207. By making the second population 280 inverselybiased, more than the majority of the candidate solutions from thesecond population 280 will be significantly different from the survivorindividual 207. For example, the majority of the candidate solutionsfrom the second population 280 will have more than approximately fiftypercent (50%) of their bits values different from the bit values ofcandidate solutions for the first population 220 and from the bit valuesof the survivor individual 207. In comparison, if the candidatesolutions of the second generation 280 were to be generated randomly,without inverse biasing, the candidate solutions from the secondpopulation 220 would have approximately 50% of their bits in common withbit values from the survivor individual 207. In other words, whenrandomly generating an individual for a population, a random numbergenerator would have a choice of between one value of “1” and one valueof “0.” Thus, the bit has a fifty-fifty (50/50) chance of being a “1” ora “0.” However, the biased population generator 212 generates the secondpopulation 280 using an inverted vector of probabilities 260 that isinversely biased, or biased away from, averages of bit values for thefirst population 220. The biased population generator 212 uses theinverted vector of probability 260 to bias bit values of strings in thesecond population 280 by amounts inversely proportional to a degree ofbias of the bit values of candidate solutions in the first population220 or of the survivor individual 207. In other words, the more settled,or biased, a bit value was in the first population 220, the biasedpopulation generator 212 shifts the bias in the opposite direction, orinversely. The inversion of bias causes an increase in effectiveness ofthe population based optimization algorithm simulator 101 to find morefit individuals in the second population 280, or at least delay theamount of time that a population will converge on a suboptimal solution.The biased population generator 212 intentionally favors individualsthat are more different and, thus, introduces a factor, beyond thefitness function itself, that adds diversity to the second population280 and/or gives enough oppositely biased diversity to give the secondpopulation 280 a chance to survive long enough to yield a possibleimprovement to first population 220 before the survivor individual 207begins to dominate the second population 280. In other words, the newlygenerated individuals from the second population 280 are biased awayfrom the makeup of individuals in the first population 220 encouragingsearching of more distant/different parts of the solution space. Theaverage individual is more different than a survivor individual thanunder conventional schemes, requiring more time for crosses with thesurvivor and its descendents to reconverge, and hence allowing more timefor a superior individual to emerge.

The biased population generator 212 inversely biases the secondpopulation 280 from the first population 220 by, at stage “C,”generating a vector of probability (VOP) 250 for the first population220. The vector of probability includes percentages that represent anumber of times that bit values for any given bit position of a stringin the first population 220 is a value of “1.” For example, a VOPgenerator 225 looks at a first bit position for all candidate solutionstrings in the first population 220 and determines a percentage of thenumber of times, over the entire population, that the first bit positionhad a bit value of “1.” The first bit of all of the candidate solutionsstrings in the first population 220 may have been a “1,” for instance,only 1% of the time. The VOP generator 225 thus writes in the firstposition of the VOP 250 a value of “0.01,” which is the percentage valueof “1%” written in a proportion format. The VOP generator 225 does thesame for all bit positions of the candidate solution strings of thefirst population 220 and respectively, for each bit position, writesinto the VOP 250 a corresponding proportion percentage, or probabilityvalue, that the bit value was a “1” in the first population 220. Forexample, the VOP generator 250 determines that the first bit position ofcandidate solution strings of the first population 220 was a “1” value1% of the time, the second bit position of candidate solution strings ofthe first population 220 was a “1” value 72% of the time, and so forthto the last bit position of candidate solution strings of the firstpopulation 220 which was a “1” value 63% of the time. The VOP generator250, then writes corresponding proportion values (e.g., 0.01, 0.72 . . ., 0.63) in the VOP 250. At stage “D,” the biased population generator212, via a VOP inverter 252, inverts the VOP 250, generating an invertedVOP (IVOP) 260. The VOP inverter 252, for instance, subtracts each ofthe proportion values in the VOP 260 from the numerical value of “1,”resulting in an opposing or inverted percentage. In other words, if thefirst bit of the VOP 250 was a value of “0.01” then the correspondinginverted bit in the IVOP 260 would be a value of “0.99,” and so forthfor all of the values of the VOP 250 (e.g., the first value of the IVOP260 is 0.01, the second value of the IVOP 260 is 0.28, and so forth forall values of the IVOP 260 with the last value of the IVOP 260 being0.37). The biased population generator 212, at stage “E,” via anindividual generator 290, generates random numbers on a scale equivalentto the a size of the proportional values of the IVOP 260 (e.g., a randomnumber generator 291 generates random numbers from “0.00” to “0.99”which matches a number of decimal points used by the proportional valuesof the IVOP 260). The individual generator 290 then converts the randomnumber to a value of “1” if the random numbers fall within an equivalentpercentage value range represented by the values of the IVOP 260. Forexample, a biasing module 292 converts a random number of “0.23” to a“1” because it falls within a range of 0.0 to 0.98, representative ofthe “0.99” value, specified by the first value in the IVOP 260. If therandom numbers falls outside an equivalent percentage value rangerepresented by the values of the IVOP 260, then the biasing module 292converts the random number to a value of “0.” The individual generator290 then organizes the 1's and the 0's into bit strings that representthe candidate solutions of the second population 280.

At stage “G,” the cataclysm controller 120 un-quarantines the survivorindividual 207 in the second population 280 after the population-basedoptimization algorithm simulator 101 has calculated multiple generationsof the second population 280. For example, the cataclysm controller 110delays the introduction of the survivor individual 207 into the secondpopulation 280 until the second generation 280 has received some levelof fitness, otherwise the survivor individual 207 would quickly dominatethe second population 280 and would cause the second population 280 toquickly become homogenous with candidate solutions similar to those ofthe first population 220. However, the cataclysm controller 110 does notdelay the introduction of the survivor individual 207 so long that thesecond population 280 plateaus again. The delay causes the secondpopulation 280 to have enough diversity of candidate solutions so thatthe survivor individual 207 can compete and have a chance of makingevolutionary advancements over the first population 220. In someembodiments, the cataclysm generator 110 can delay introduction of thesurvivor individual 207 until the second population 280 has experiencedat least one generation but no more than approximately 10 generations.

Further, although FIG. 2 depicts the biased population generator 212 asa component of the cataclysm controller 110, the biased populationgenerator 212 can be a separate element from the cataclysm controller110. Further, one or more of the components of the biased populationgenerator 212 may be separate, such as the random number generator 291.

FIG. 3 is a flowchart depicting example operations for generating aninversely biased population during a simulation of an optimizationproblem. For exemplary purposes, operations associated with the blocksin FIG. 3 will be described as being performed by a system associatedwith a population-based optimization algorithm simulation. The systemperforms the flow 300 of FIG. 3. The system includes, in someembodiments, the population-based optimization algorithm simulator 101,the cataclysm controller 110, the VOP generator 225, the VOP inverter252, the individual generator 290, the random number generator 291, thebiasing module 292, etc. of FIGS. 1 and 2. In some embodiments, thesystem may include any of the elements described in FIGS. 4 and 5.Further, in some embodiments, the system is similar to the system 700specified in FIG. 7. Further, FIGS. 4 and 5 are example conceptualdiagrams of generating an inversely biased population during asimulation of an optimization problem and will be referred to in concertwith FIG. 3. Referring to FIG. 3, the system determines that a firstpopulation of bit strings has converged on a suboptimal solution duringa simulation of an optimization problem using a population-basedoptimization algorithm, where the bit strings represent candidatesolutions of the optimization problem (302).

Further, the system computes a first vector of first proportion valuesfor the first population of bit strings, where each of the firstproportion values represents a percentage of times that a given bitposition of the first population of bit strings is a value of “1” (304).For example, referring now to FIG. 4, a first population of candidatesolutions (“first population”) 420 includes N number of individualcandidate solutions structured, for example, as binary bit strings (“bitstrings”) 420A-N. Each of the bit strings 420A-N is a separate instanceof a specific vector space (“vector”) 402, with a sequence of values402A-N that are organized in bits positions (“positions”) 404A-N. Thus,each of the bit strings 420A-N have an equivalent length (i.e., an equalnumber of bits), and each bit represents an equivalent portion of apotential solution. All of the bits in the bit strings 420 A-N arebinary values, meaning either one of two values, typically the numericalvalues of zero (“0”) or one (“1”). For example, a first bit string 420Aincludes a first bit value 412A that has a value of “0”, a second bitvalue 412B that has a value of “1,” and all other bits values of thefirst bit string 420A are either “0” or “1” until the final bit value412N, which has a value of “1.” It should be noted that although the bitvalues 412A-N may not necessarily each represent a complete potentialsolution value for each variable of an optimization problem, but mayonly be a bit in a larger value that represents one potential solutionvalue for one variable. For instance, the “0” value of the first bitvalue 412A and the “1” value of the second bit value 412B do notseparately represent potential values for separate variables of theoptimization problem, but may be only the first two binary bits of aspecific number of bits (e.g., “0100110”) which together constitute asingle numerical value (e.g., “38”) that represents a potential solutionvalue for one variable of the optimization problem. Other specificnumbers of bits may follow in the first bit string 420A for all othervariables of the optimization problem for the one candidate solution forthe first bit string 420A. Further, the bit strings 420A-N may also bestring-based abstractions of a tree structure, a formula, an equation,an operator, a code block or any other type of optimization problemelements. However, each bit position 404A-N represents an equivalentportion of a potential solution across all bit positions 404A-N (e.g.,the first bit 412A of the first bit string 420A, the first bit 413 ofthe second bit string 420B, and the first bit 414 of the last bit string420N all represent the first bit of potential values for the samevariable in the optimization problem description). The system generatesa single dimensional vector of probabilities (“VOP”) 450 with an equalnumber of probability values 451A-N as there are numbers of bitspositions 404A-N. In one embodiment, the probability values 451A-N eachrepresent a percentage of times that bit values in the positions 404A-Nare a value of “1.” In other words, for instance, the system counts thenumber of times that the first bit values that correspond to the firstposition 404A, for all of the bit strings 420A-N, are the value of “1”and divides the count by the number of bit strings 420A-N to generatethe first probability value 451A. For example, the system starts withthe first bit string 420A, examines the first bit value 412A, anddetermines that the value is not a “1.” The system moves on to thesecond bit string 420B, examines the bit value 413 and also determinesthat the value is not a “1”, then moves on to each successive bitstring, incrementing a count when the system examines that the value ofthe first bit value for the bit string is a “1” until reaching the lastbit value 414. If, for instance, there were one hundred bit strings420A-N and one of the bits in the first position 404A were a value of“1”, the system would divide the value of one by the value of onehundred to derive a percentage of 1%, which is equivalent to aproportion value of “0.01.” The system then writes the proportion valueof “0.01” as the first probability value 451A. The system then repeatsthe iterative count for the second position 404B, and divides by thenumber of bit strings 420A-N, and calculates a second probability value451B of “0.72” (e.g., 72% of the bit values for the second position 404Bare a value of “1”). The system repeats the iterative counts anddivisions for each of the positions 404A-N, until determining a finalprobability value 451N of “0.63” (e.g., 63% of the bit values for thefinal bit position 404N are a value of “1”).

It should be noted that despite the number of bit strings 420A-N, thesystem can round the percentage values to generate a probability valuethat fits a required format (e.g., so that the probability value is aproportion value of a certain number of decimal points). For example, ifthere were one-thousand bit strings 420A-N and the count for the bitvalues of the first position 404A came to a count total of “8”, and ifthe system divided “8” by “1000,” the actual percentage would come to avalue of “0.008.” However, to fit a two decimal proportion, the systemcan round up to a value of “0.01”. Further, in other embodiments, theprobability values 451A-N could represent a percentage of times that bitvalues in the positions 404A-N are a value of “0” instead of the valueof “1.” The value of “1” or “0” can be pre-specified by a user (e.g., auser specifies, via a tool, prior to calculating the vector ofprobabilities, to count the percentage of times that the bit value is“1” versus “0” or vice-versa). In other embodiments, however, the systemcan determine whether to choose “1” or “0” as the number to count basedon analysis of the first population. The system could, for example,choose the “1” or the “0” value based on whether fewer 1's or 0's existin the bit strings of the first population. Further, in some embodimentsthe system can optionally add random noise to the VOP 450 by randomlychoosing a small subset of the probability values 451A-N and adding asmall random value to small subset (e.g., 0-5%) of the probabilityvalues 451A-N.

Returning to FIG. 3, the system further generates a second vector ofsecond proportion values by subtracting each of the first proportionvalues from 1 so that the second proportion values are inversely biasedfrom the first proportion values (306). In FIG. 4, for example, a VOPinverter 452 individually subtracts all of the probability values 451A-Nfrom the value of “1” to generate an inverted VOP 460 with invertedprobability values 461A-N. For instance, the VOP inverter 452 subtractsthe value of “0.01” for the first probability value 451A from the valueof “1,” which results in a first inverted probability value 461A of“0.99”. The system subtracts the value of “0.72” for the secondprobability value 451B from the value of “1,” which results in a secondinverted probability value 461B of “0.28” and so forth until thegenerating the last inverted probability value 461N of “0.37”.

Returning to FIG. 3, the system optionally modifies any of the secondproportion values that exceed a bias range (308). For example, in FIG.4, an excessive bias adjustment unit 462 can modify any of the invertedprobability values 461A-N if they are above or below specific thresholdprobability values. For instance, the excessive bias adjustment unit 462is configured to modify any of the inverted probability values 461A-Nthat are over the value of “0.90” down to the value of “0.90” and modifyany of the inverted probability values 461A-N that are under the valueof “0.10” up to the value of “0.10”. The first inverted probabilityvalue 461A is the value of “0.99,” which is excessively high accordingto threshold settings for the excessive bias adjustment unit 462, andthus modifies the first inverted probability value 461A down to a valueof “0.90”. In some embodiments, the excessive bias adjustment unit 462can be configured to other ranges of threshold values. In someembodiments, the excessive bias adjustment unit 462 can set thethresholds based on input from a user. In some embodiments, theexcessive bias adjustment unit can automatically modify the thresholdvalues based on an overall amount of excessive bias in the inverted VOP460. For example, the system can change the threshold range based on anumber of the inverted probability values 461A-N that are excessivelybiased. The excessive bias adjustment unit 462 thus ensures that none ofthe inverted probability values 461A-N are too highly biased toward a“1” or a “0,” ultimately leading to increased diversity in apost-cataclysmic population. The excessive bias adjustment unit 462generates a modified inverted VOP 470. The modified inverted VOP 470includes modified inverted probability values 471A-N. In someembodiments, the system can modify any of the probability values451A-451N if excessively biased instead of, or in addition to, modifyingthe inverted probability values 461A-461N. In other words, the excessivebias adjustment unit 462 can modify probability values at any pointafter generating the VOP 450.

Returning again to FIG. 3, the system further generates a plurality ofrandom numbers, converts the random numbers to “1” or “0” values basedon the second proportion values, and generates a second population ofbit strings using the “1” or “0” values, where the second population isinversely biased from the first population of bit strings (310). Forexample, in FIG. 5 a random number generator 591 generates randomnumbers 594. The random number generator 591 is configured to generatethe random numbers 594 in range of values from “0” to “0.99,” or someother number range that can be used to represent percentage values(e.g., “0” to “99” or some other number range that can be scaled to 100units). For a first random number 594A, a biasing module 592 can utilizea first converter 596A that uses a conversion factor equivalent to thefirst modified inverted probability value 471A. In other words, becausethe first modified inverted probability value 471A is a value of “0.90”,the first converter 596A is configured to convert the first randomnumber 594A to a value of “1” if the first random number 594A is between“0” and “0.89” and convert the first random number to a value of “0” ifthe first random number 594A is between “0.90” and “0.99”. As anexample, the first random number 594A is a value of “0.59”. According tothe conversion factor of the first converter 596A, the first converter596A converts the value of “0.59” to a value of “1”. The system theninserts the value of “1” as a first bit value 581A of a first bit string580A for a second population 580 of bit strings 580A-N. The systemconverts, via a second converter 596B, a second random number 594B froma value of “0.21” to a value of “1” and inserts the value of “1” as asecond bit value 581B of the first bit string 580A. The second converter596B has a conversion factor that matches the second modified invertedprobability value 471B. The system continues to convert random numbersin a first row of the random numbers 594 into “1” or “0” values andinserting the “1” or “0” values into the first bit string 580A until afinal converter 596N converts a final random number 594N from a value of“0.45” to a value of “0” as a final bit value 581B of the first bitstring 580A. The final converter 596B has a conversion factor thatmatches the final modified inverted probability value 471N. The systemrepeats conversion of all rows of the random numbers 594 into bitstrings 580A-N.

If the system used a purely random number generator (e.g., 50/50 chanceof either a “1” or a “0”) without the biasing module 592, then thesystem would generate the second population 580 having approximatelyfifty percent of its bit values in common with bit values from the firstpopulation 420. However, by generating random numbers within a numberrange that can be used to represent percentage values and using thebiasing module 592, the system generates the second population 580 tohave most of its bit values inversely biased away from bit values fromthe first population 420. The use of the converters 596A-N are similarto use of a multi-faced die (e.g., a hundred-sided die) where the numberof the faces on the die vary for each converter 596A-N based on thevalue of the modified inverted probability values 471A-N. For example,using the example of the hundred-sided die, for the first converter596A, ninety of the sides of the hundred-sided die would represent avalue of “1” and ten of the sides would the value of “0.” A random rollof the die would have a 90% change of producing a “1” and a 10% changeof producing a “0.” Thus, although the roll of the die is random, theprobabilities of a certain outcome are biased in favor of either a “1”or a “0” value based on the value of the modified inverted probabilityvalue 471A. For the second converter 596B, twenty eight of the sideswould represent a “1” and seventy-two of the sides would represent a “0”etc.

FIG. 6 is a flowchart depicting example operations for quarantining anindividual from a first population of candidate solutions during asimulation of an optimization problem and integrating the individual ina second population of candidate solutions. For exemplary purposes,operations associated with the blocks in FIG. 6 will be described asbeing performed by a system associated with a population-basedoptimization algorithm simulation. The system performs the flow 600 ofFIG. 6. The system includes, in some embodiments, the population-basedoptimization algorithm simulator 101, the cataclysm controller 110, theVOP generator 225, the VOP inverter 252, the individual generator 290,the random number generator 291, the biasing module 292, etc. of FIGS. 1and 2. In some embodiments, the system may include any of the elementsdescribed in FIGS. 4 and 5. Further, in some embodiments, the system issimilar to the system 700 specified in FIG. 7. Referring to FIG. 6, thesystem determines that a first population of first candidate solutionshas converged on a suboptimal solution during a simulation of anoptimization problem using a population-based optimization algorithm(602). In some embodiments, the first population of candidate solutionsmay be string based (e.g. bit strings), trees, or any other type ofindividual used in a population-based optimization algorithm simulation.

Further, the system selects at least one of the first candidatesolutions from the first population (604). In some embodiments, thesystem selects the at least one of the first candidate solutions usingelitist selection, fitness-based or ranked-based selection, randomselection, or some combination thereof. For example, in one embodiment,the system selects the at least one of the first candidate solutions(survivor individual) because it has a high degree of fitness accordingto a fitness function for the optimization problem. In some embodiments,the system selects only one of the first candidate solutions to survivea cataclysm. In other embodiments, however, the system selects multipleones of the first candidate solutions. The system can select thesurvivor individual using a random selection and evaluate the selectedsurvivor individual to ascertain sufficient fitness according to fitnesscriteria in the fitness function. If a selected survivor individual isnot sufficiently fit, then the system selects different one(s) of thefirst candidate solutions and evaluates their fitness until finding atleast one individual that is sufficiently fit according to the fitnesscriteria. In some embodiments, the system can provide a tool so thatusers can select a survivor individual(s).

Further, the system quarantines the at least one of the first candidatesolutions (606). For example, the system can store a copy of the atleast one of the first candidate solutions on a computer-readablestorage medium for later use. In some embodiments, the system can storethe remainder of the first candidate solutions of the first populationfor future reference. In another embodiment, the system can mark thesurvivor individual(s) such that that survivor individual(s) are notallowed to participate in genetic operations (other than reproduction)for multiple generations that follow.

Further, the system performs a cataclysm on the first population offirst candidate solutions and generates a second population of secondcandidate solutions (608). In some embodiments, the system can perform amass-extinction type of cataclysm which kills off, removes, or otherwisedisregards the first population and randomly generates a secondpopulation. In some embodiments, the system can perform a mass mutationtype of cataclysm where the first population is replaced with severelymutated versions of the individuals from the first population (e.g.,15-25% of the bits are flipped to significantly change the individuals).In some embodiments, the system generates the second population usingthe inverse biasing as described previously. In some embodiments, thesystem provides a tool that allows users to select a type of cataclysm,or other parameters associated with the cataclysm. One should note thata second population may also be a highly modified version of the firstpopulation (e.g., by modifying candidate solutions from the firstpopulation instead of, or in addition to, discarding and replacingcandidate solutions from the first population). Thus, the secondpopulation may also be referred to a population that is new, modified,post-cataclysmic, or some other phrase that specifies it is differentfrom the first population and no longer in a state that is converged ona sub-optimal solution.

Further, the system computes multiple generations of the secondpopulation and fully integrates the at least one of the first candidatesolutions into the second population after computing the multiplegenerations of the second population but before the second populationconverges on an additional suboptimal solution (610). For example, thesystem can delay the introduction of a copy of the at least one of thefirst candidate solutions into the second population. In anotherembodiments, the system can introduce the at least one of the firstcandidate solutions (survivor individual) into the second populationimmediately, but mark the survivor individual and restrict the survivorindividual's ability to compete until after computing the multiplegenerations. By waiting to fully integrate the survivor individual untilafter multiple generations, the system gives the second population timeto generate its own fit individuals, according to the fitness function.In other words, the simulation of the population-based algorithm andwaits to fully integrate (e.g., introduce, unmark, unrestrict, etc.) thesurvivor individual(s) into the simulation until a number of generationsare computer for the second population after the cataclysm. The soonerthe system fully integrates the survivor individual(s) into the secondpopulation, the more quickly the survivor individual(s) may influence(e.g., dominate) the second population. However, if the system waits toolong, (e.g., beyond approximately 10 generations), then the secondpopulation will begin to converge on its own suboptimal solution andbecome too homogenous. Therefore, in some embodiments, the system fullyintegrates the quarantined survivor individual(s) into the secondpopulation after one generation has been computed but no less thanapproximately 10 generations have been computed according to the fitnessfunction of a population-based optimization algorithm after thecataclysm.

In some embodiments, the system can run multiple simulations where eachsimulation converges on separate suboptimal solutions. After eachsimulation converges on the separate suboptimal solutions, the systemmay select a survivor from each of the simulations and perform acataclysm to the rest of the populations for all of separate populations(e.g., eliminate all other candidate solutions from the populationsother than the survivors). The system can then generate a secondpopulation and then insert the multiple survivors into the secondpopulation after multiple generations so that all of the multiplesurvivors can compete within the second population.

As will be appreciated by one skilled in the art, aspects of the presentinventive subject matter can be used to optimize all types ofoptimization problems such as problems regarding electronics,thermodynamics, physics, aeronautics, acoustics, etc. Further, it shouldbe noted that although inverse-biasing was described above for binarysolution representations (e.g., binary strings), other embodiments caninclude extending or applying inverse-biasing to tools with non-binarysolution representations (e.g., by intentionally favoring differentvalues regardless of whether the values are binary in nature). Further,to avoid creating an inverse bias that is too heavily biased away from asurvivor (i.e., to avoid creating a second population that ishomogeneous in its heavy bias away from a survivor), some embodimentsmay include limiting a scale to the bias so that the second populationis biased away from a survivor by more than approximately 50% but alsohighly random. For instance, some embodiments can cap a bias at 10%, oralternatively scale the difference between the bit-frequency and 50%.For example, in the case of scaling the different between thebit-frequency and 50%, if the bit is set 99% of the time, for example,some embodiments may divide (0.99−0.50) by some scale factor “X” (e.g.,(0.99−0.50)/X), add back the 0.50, and then subtract from 1.0 to invertthe bit value. The scale factor (X) could be determined randomly, from 0to 10 for example, for each cataclysm.

Further, it should be noted that although examples above describecomputing generations of a population, other examples may includeprocessing an objective function until pre-specified criteria has beensatisfied (e.g., for a specific amount of time, until a specificpercentage of bits in a population have a specific value, etc.). Forinstance, some optimizations algorithms may process an objectivefunction in ways that do not necessarily compute generations, unlikeevolutionary algorithms which do compute generations using a fitnessfunction. Some embodiments of the invention, therefore, may quarantinean individual, process the objective function (e.g., computeoptimizations according to the objective function) until the specificcriteria has been satisfied (e.g., for a period of time), then integratethe quarantined individual after the specific criteria has beensatisfied.

Further, as will be appreciated by one skilled in the art, aspects ofthe present inventive subject matter may be embodied as a system, methodor computer program product. Accordingly, aspects of the presentinventive subject matter may take the form of an entirely hardwareembodiment, an entirely software embodiment (including firmware,resident software, micro-code, etc.) or an embodiment combining softwareand hardware aspects that may all generally be referred to herein as a“circuit,” “module” or “system.” Furthermore, aspects of the presentinventive subject matter may take the form of a computer program productembodied in one or more computer readable medium(s) having computerreadable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent inventive subject matter may be written in any combination ofone or more programming languages, including an object orientedprogramming language such as Java, Smalltalk, C++ or the like andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The program codemay execute entirely on the user's computer, partly on the user'scomputer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through any type of network, includinga local area network (LAN) or a wide area network (WAN), or theconnection may be made to an external computer (for example, through theInternet using an Internet Service Provider).

Aspects of the present inventive subject matter are described withreference to flowchart illustrations and/or block diagrams of methods,apparatus (systems) and computer program products according toembodiments of the inventive subject matter. It will be understood thateach block of the flowchart illustrations and/or block diagrams, andcombinations of blocks in the flowchart illustrations and/or blockdiagrams, can be implemented by computer program instructions. Thesecomputer program instructions may be provided to a processor of ageneral purpose computer, special purpose computer, or otherprogrammable data processing apparatus to produce a machine, such thatthe instructions, which execute via the processor of the computer orother programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

FIG. 7 depicts an example computer system. A computer system includes aprocessor unit 701 (possibly including multiple processors, multiplecores, multiple nodes, and/or implementing multi-threading, etc.). Thecomputer system includes memory 707. The memory 707 may be system memory(e.g., one or more of cache, SRAM, DRAM, zero capacitor RAM, TwinTransistor RAM, eDRAM, EDO RAM, DDR RAM, EEPROM, NRAM, RRAM, SONOS,PRAM, etc.) or any one or more of the above already described possiblerealizations of machine-readable media. The computer system alsoincludes a bus 703 (e.g., PCI bus, ISA, PCI-Express bus, HyperTransport®bus, InfiniBand® bus, NuBus bus, etc.), a network interface 705 (e.g.,an ATM interface, an Ethernet interface, a Frame Relay interface, SONETinterface, wireless interface, etc.), and a storage device(s) 709 (e.g.,optical storage, magnetic storage, etc.). The computer system alsoincludes a population-based optimization algorithm simulator 721. Thepopulation-based optimization algorithm simulator 721 finds solutions tooptimization problems in accordance with population-based optimizationalgorithms. The population-based optimization algorithm simulator 721comprises a cataclysm controller 710. The cataclysm controller 710 cancontrol cataclysms during a simulation of a population-basedoptimization algorithm. Any one of these functionalities may bepartially (or entirely) implemented in hardware and/or on the processingunit 701. For example, the functionality may be implemented with anapplication specific integrated circuit, in logic implemented in theprocessing unit 701, in a co-processor on a peripheral device or card,etc. Further, realizations may include fewer or additional componentsnot illustrated in FIG. 7 (e.g., video cards, audio cards, additionalnetwork interfaces, peripheral devices, etc.). The processor unit 701,the storage device(s) 709, and the network interface 705 are coupled tothe bus 703. Although illustrated as being coupled to the bus 703, thememory 707 may be coupled to the processor unit 701.

While the embodiments are described with reference to variousimplementations and exploitations, it will be understood that theseembodiments are illustrative and that the scope of the inventive subjectmatter is not limited to them. In general, techniques for optimizingseeding of population-based optimization algorithm simulations asdescribed herein may be implemented with facilities consistent with anyhardware system or hardware systems. Many variations, modifications,additions, and improvements are possible.

Plural instances may be provided for components, operations, orstructures described herein as a single instance. Finally, boundariesbetween various components, operations, and data stores are somewhatarbitrary, and particular operations are illustrated in the context ofspecific illustrative configurations. Other allocations of functionalityare envisioned and may fall within the scope of the inventive subjectmatter. In general, structures and functionality presented as separatecomponents in the exemplary configurations may be implemented as acombined structure or component. Similarly, structures and functionalitypresented as a single component may be implemented as separatecomponents. These and other variations, modifications, additions, andimprovements may fall within the scope of the inventive subject matter.

What is claimed is:
 1. A method for modifying candidate solutions of anoptimization problem, the method comprising: selecting at least onecandidate solution from a first plurality of candidate solutions,wherein the first plurality of candidate solutions has converged on asuboptimal solution during a computer simulation that tests fitness ofthe first plurality of candidate solutions for the optimization problem;storing a copy of the at least one candidate solution; performing acataclysm on the first plurality of candidate solutions; generating asecond plurality of candidate solutions; and after one or moreadditional computer simulations that test the fitness of the secondplurality of candidate solutions for the optimization problem,integrating the copy of the at least one candidate solution into thesecond plurality of candidate solutions.
 2. The method of claim 1further comprising: quarantining the copy of the at least one candidatesolution from the cataclysm and from the one or more additional computersimulations that test the fitness of the second plurality of candidatesolutions for the optimization problem.
 3. The method of claim 1 furthercomprising: integrating the copy of the at least one candidate solutioninto the second plurality of candidate solutions before the secondplurality of candidate solutions converges on an additional suboptimalsolution.
 4. The method of claim 1 further comprising: performing theone or more additional computer simulations until an optimizationcriterion has been satisfied for the second plurality of candidatesolutions.
 5. The method of claim 4, wherein the optimization criterioncomprises a number of generations of optimizations of a population-basedoptimization algorithm, and further comprising computing the number ofgenerations of the optimizations of the population-based optimizationalgorithm for the second plurality of candidate solutions.
 6. The methodof claim 5, wherein the number of generations of the optimizations ofthe population-based optimization algorithm is greater than 1 generationand less than approximately 10 generations.
 7. The method of claim 4,wherein the optimization criterion is a pre-specified time period. 8.The method of claim 1 further comprising: associating a mark with thecopy of the at least one candidate solution; and restricting the copy ofthe at least one candidate solution from interacting with the secondplurality of candidate solutions based on the detecting the mark.
 9. Themethod of claim 1, wherein the copy of the at least one candidatesolution comprises at least one of a plurality of bit strings, andfurther comprising generating the second plurality of candidatesolutions using an inverted vector of probabilities, wherein theinverted vector of probabilities specifies an inverted bias for bitvalues in the at least one of the plurality of bit strings.
 10. Themethod of claim 9, wherein the generating the second plurality ofcandidate solutions comprises: converting random numbers to bit valuesof either 1 or 0 using the inverted vector of probabilities; andinserting the bit values of either 1 or 0 into bit strings for thesecond plurality of candidate solutions.
 11. An apparatus comprising: aprocessing unit; and a computer readable storage medium configured tostore instructions which, when executed by the processing unit, performone or more operations to select at least one candidate solution from afirst plurality of candidate solutions, wherein the first plurality ofcandidate solutions has converged on a suboptimal solution during acomputer simulation that tests fitness of the first plurality ofcandidate solutions for the optimization problem, store a copy of the atleast one candidate solution, perform a cataclysm on the first pluralityof candidate solutions, generate a second plurality of candidatesolutions, and integrate the copy of the at least one candidate solutioninto the second plurality of candidate solutions after performance ofone or more additional computer simulations that test the fitness of thesecond plurality of candidate solutions for the optimization problem.12. The apparatus of claim 11, wherein the computer readable storagemedium is configured to store instructions which, when executed by theprocessing unit, perform one or more additional operations to quarantinethe copy of the at least one candidate solution from the cataclysm andfrom the one or more additional computer simulations that test thefitness of the second plurality of candidate solutions for theoptimization problem.
 13. The apparatus of claim 11, wherein thecomputer readable storage medium is configured to store instructionswhich, when executed by the processing unit, perform one or moreoperations to integrate the copy of the at least one candidate solutioninto the second plurality of candidate solutions before the secondplurality of candidate solutions converges on an additional suboptimalsolution.
 14. The apparatus of claim 11, wherein the computer readablestorage medium is configured to store instructions which, when executedby the processing unit, perform one or more operations to perform theone or more additional computer simulations until an optimizationcriterion has been satisfied for the second plurality of candidatesolutions.
 15. The apparatus of claim 14, wherein the optimizationcriterion comprises a number of generations of optimizations of apopulation-based optimization algorithm, and wherein the computerreadable storage medium is configured to store instructions which, whenexecuted by the processing unit, perform one or more operations tocompute the number of generations of the optimizations of thepopulation-based optimization algorithm for the second plurality ofcandidate solutions.
 16. The apparatus of claim 15, wherein the numberof generations of the optimizations of the population-based optimizationalgorithm is greater than 1 generation and less than approximately 10generations.
 17. The apparatus of claim 14, wherein the optimizationcriterion is a pre-specified time period.
 18. A computer program productfor modifying candidate solutions of an optimization problem, thecomputer program product comprising: a non-transitory computer readablestorage medium having computer readable program code embodied therewith,the computer readable program code configured to select at least onecandidate solution from a first plurality of candidate solutions,wherein the first plurality of candidate solutions has converged on asuboptimal solution during a computer simulation that tests fitness ofthe first plurality of candidate solutions for the optimization problem,store a copy of the at least one candidate solution, perform a cataclysmon the first plurality of candidate solutions, quarantine the copy ofthe at least one candidate solution from the cataclysm, generate asecond plurality of candidate solutions, after the cataclysm isperformed, perform one or more additional computer simulations that testthe fitness of the second plurality of candidate solutions for theoptimization problem, and integrate the copy of the at least onecandidate solution into the second plurality of candidate solutionsafter performance of the one or more additional computer simulations.19. The computer program product of claim 18, wherein the copy of the atleast one candidate solution comprises at least one of a plurality ofbit strings, and wherein the computer readable storage medium hascomputer readable program code embodied therewith, the computer readableprogram code configured to generate the second plurality of candidatesolutions using an inverted vector of probabilities, wherein theinverted vector of probabilities specifies an inverted bias for bitvalues in the at least one of the plurality of bit strings.
 20. Thecomputer program product of claim 19, wherein the computer readablestorage medium has computer readable program code embodied therewith,the computer readable program code configured to: convert random numbersto bit values of either 1 or 0 using the inverted vector ofprobabilities; and insert the bit values of either 1 or 0 into bitstrings for the second plurality of candidate solutions.